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CLAIM OF PRIORITY 

This application claims priority under 35 U.S.C. 

119(e)(1) from U.S. Provisional Application No. 60/463,263 
filed April 16, 2003. 

TECHNICAL FIELD OF THE INVENTION 

The technical field of this invention is compressed data 
decoding data encoded with reversible variable length codes. 
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BACKGROUND OF THE INVENTION 

Variable length codes (VLC) are widely used in data 
compression and particularly in image compression. The set of 
possible codewords are assigned codes of varying lengths. More 
5 frequently used codewords are assigned shorter codes than less 
frequently used codewords. Exploiting such frequency of use 
achieves additional data compression because short assigned 
codes are used more frequently than long assigned codes. 

Variable length code decoding is typically implemented 
10 using lookup tables. Because the length of the codeword is not 
known before decoding, the lookup table will include redundant 
entries corresponding to whatever bits follow the codeword. 
For instance, if the codeword is 001100 but 7 bits are used 
for the lookup table index, . then either 0011000 or 0011001 
15 correspond to the same codeword. Often the amount of lookup 
table memory needed can be reduced by narrowing the search 
based on the number of leading zeroes in the code and using 
multiple tables. Many devices use hardware accelerators that 
exploit this leading zero property. Even software only 
techniques for decoding VLCs typically exploit this property 
in order to reduce the needed lookup table memory. 

Reversible variable length code (RVLC) codewords can be 
decoded in either the forward or backward direction. This 
property is believed useful in error recovery, when a special 
25 start code or marker follows the RVLC part of the bitstream. A 
single bit error in the bitstream may result in improper 
decoding. If the erroneously decoded word has a different 
length than the correct codeword, then the decoder would be 
operating on incorrect variable length code thereafter. This 
error might not be immediately detected. Some later decoding 
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error based on incorrect word boundaries may alert the decoder 
to existence of the prior error. In that case, some of the 
uncorrupted data that follows the bit errors may be recovered 
by decoding the RVLC codewords backwards from the start code 
that marks the end of the RVLC codewords. 

This special structure of reversible variable length 
codewords means they cannot be decoded efficiently using the 
techniques generally used for decoding VLCs (variable length 
codewords) . This property is useful for error recovery. 
Because RVLCs are encoded for error resilience or large free 
distance, the resulting codetree is sparse but does not 
include the leading zeros structure of typical VLCs. This 
makes efficient table lookup difficult. Thus the special 
structure of RVLC codewords makes the decoding techniques used 
15 for regular VLC codewords are less efficient. 

For example, the Simple-profile MPEG-4 has the option of 
using reversible variable length codewords. However, in the 
RVLC used in the Simple-profile MPEG-4 video standard, all but 
a few codewords have exactly one leading zero. Using a 
hardware coprocessor exploiting the leading zero parsing 
typically used in VLCs, the lookup tables require almost 21 K 
words. This amount would generally exceed the device buffer 
limitations. Thus there is a need in the art to reduce the 
amount of lookup table memory needed to decode RVLCs while 
25 using the common leading zeros decode techniques. 
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SUMMARY OF THE INVENTION 

This invention is a method for decoding a bitstream of 
reversible variable length codewords. The method parses the 
30 bitstream to extract a next reversible variable length 
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codeword. The method transcodes each extracted reversible 
variable length codeword into a pseudo-variable length 
codeword without complete decoding of the extracted reversible 
variable length codeword. The resulting pseudo-variable 
length codeword is then decoded. 

The transcoding produces at least some pseudo-variable 
length codewords suitable for leading zero lookup table 
decoding. These pseudo-variable length codewords employ 
leading zero detection for selection of a corresponding lookup 
table. This invention is especially useful when coupled with 
hardware adapted for decoding the more common leading zeros 
variable length codes. 

The transcoding generally differs for reversible variable 
length codewords with initial "0" and initial "1". These 
differing transcodings may be decoded with different sets of 
lookup tables. For reversible variable length codewords with 
initial "0" the transcoding concatenates a first portion 
corresponding to a position of a third "0", a second portion 
corresponding to a position of a second "0" and a third 
portion corresponding to the fixed length code of the 
reversible variable length code. The number of bits allocated 
to indication of the position of the second "0" depends upon 
the position of the third "0". Fewer bits are allocated when 
the position of the third "0" is smaller. 

This invention reduces the table size for an example 
reversible variable length coding from 20482 words to 330 
words for RVLC codewords beginning with 0. This invention does 
not require modification to the variable length code decoder 
(VLCD) coprocessor, but works with existing VLCD hardware. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

These and other aspects of this invention are illustrated 
in the drawings, in which: 

Figure 1 illustrates a first codetree example showing the 
5 structure of a leading zeros variable length code; 

Figure 2 illustrates a second codetree example showing 
the structure of a variable length code not having a leading 
zeros structure; 

Figure 3 illustrates the block diagram of an example of 
10 an electronic system suitable for implementing this invention; 

Figure 4 is a flow chart illustrating how to practice 
this invention; and 

Figure 5 is a flow chart illustrating an alternative 
manner of practicing this invention. 

15 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Variable length coding is used in JPEG, MPEG-1, MPEG-2 
and MPEG-4 to obtain high compression ratios. A codebook can 
be represented as a binary tree, with the path to each leaf 
20 node representing a codeword. Figure 1 illustrates an example 
codetree . 

In Figure 1, there are 8 codewords. These five codewords 
are: 1, 01, 0010, 0011, 00010, 00011, 00001 and 00000. Thus 
there is one codeword with length 1, one codeword with length 
25 2, two codewords with length 3 and four codewords with length 
5. The shortest length is 1 and the longest codeword has 
length 5. A straight-forward decoding method would examine 5 
bits and use these 5 bits as an index into a table with 32 
entries. This technique could be very inefficient, for 
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example, for a codebook with 100 codewords with maximum length 
16. In that case, the lookup table would require 2^^ entries. 

A typical prior art technique uses the number of leading 
zeros (prefix) to determine an offset to a subtable. This 
5 technique uses the remaining suffix bits as an index to the 
subtable. In the example of Figure 1, the codewords are 
divided into prefix and suffix as shown in Table 1. 



Codeword 


Prefix 


Suffix 


1 




1 


01 


0 


1 


0010 


00 


10 


0011 


00 


11 


00010 


• 000 


10 


00011 


000 


11. 


00001 


0000 


1 


00000 


00000 





10 Table 1 



A table with 6 offsets for 0 to 5 leading zeros would select a 
corresponding subtable. These subtables could be concatenated 
into 8 consecutive entries. This provides a total of 14 

15 entries rather than the original 32. Note that all suffixes 
begin with 1, but this can be absorbed into the offset. Thus a 
leading zeros technique is quite useful for many compression 
standards. Note that a similar leading ones technique could 
also be applied to a corresponding leading one codetree. 

20 Figure 2 illustrates the first 9 zero starting codes in 

the MPEG-4 RVLC table. The codetree of Figure 2 does not have 
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the leading-zeros structure. This codebook has one codeword of 
length 4 (0001), four codewords of length 5 (00100, 00101, 
01000 and 01001) and four codewords of length 6 (001100, 
001101, 010100 and 010101) . The leading zero prefixes and 
5 suffixes for these nine codes are shown in Table 2. 



Codeword 


Prefix 


Suffix 


01000 


0 


1000 


01001 


0 


1001 


010100 


0 


10100 


010101 


0 


10101 


00100 


00 


100 


00101 


00 


101 


001100 


■ 00 


1100 


001101 


00 


1101 


0001 


000 


1 



Table 2 



10 Using the leading zeros technique requires storing 3 offsets 
for 1 to 3 leading zeros. The codewords with prefix 0 have a 
suffix of up to 4 bits after discarding first 1. Thus the 
subtable 'for prefix 0 requires 16 entries. The codewords with 
prefix 00 have a suffix of up to 3 bits after discarding the 

15 leading 1. Thus the subtable for prefix 00 requires 8 entries. 
There is only a single codeword with prefix 000, thus this can 
be decoded by the initial leading zero technique. Note that 
the subtrees are sparse and not full. This is in contrast with 
the example of Figure 1 where each subtree is full. The larger 

20 tables required for this example include space for invalid 
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codewords. For example, Ollxx might appear in a bitstream with 
errors and the decoder should return an error code. Even 
assuming uncorrupted bitstreams, the leading-zeros tables use 
space inefficiently when the VLC does not have a leading zeros 
5 structure. 

This application will describe an example of use of this 
invention for MPEG-4 RVLC. This technique transcodes the RVLC 
codetree into another codetree with the preferred leading 
zeros structure. The transcoded codewords are then decoded as 

10 known in the art using a hardware accelerator or a software 
decoder. This technique is useful for decoding devices which 
have leading-zeros VLD processing in hardware with limited 
table space. This transcoding does not require full decoding 
and re-encoding. Instead, each RVLC codeword is parsed and a 

15 pseudo-VLC codeword generated corresponding to a pseudo- 
codetree. Because the RVLC data stream may be decoded in both 
a forward direction and a backward direction, this parsing of 
the codewords is possible without complete decoding. This 
pseudo-codetree is selected to permit efficient decoding using 

20 leading zeros variable length decoding methods. 

Reversible variable length codes (RVLC) can be decoded in 
either the forward or backward direction. These codes are 
useful when the data may be corrupted by errors. The MPEG-4 
video standard includes an option to use RVLC for the DCT 

25 data. The RVLC for MPEG-4 is formed by concatenating a 
variable length code (VLC) with a fixed length code (FLC) . The 
FLC part has 2 bits which includes the sign bit. The VLC part 
either: starts and ends with a 1 with all (or no) 0 in 
between; or starts and ends with a 0 with one 0 in between and 

30 any remaining bits equal to 1. The longest valid RVLC codeword 
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is. 15 bits plus a sign bit. Thus the VLC part can be as long 
as 14 bits. Depending on the first bit, the VLC part may be as 
short as 2 bits starting with a 1 (11) or as short as 3 bits 
starting with a 0 (000) . 

The codebook is very sparse due to way the RVLC was 
designed. Not all RVLC codewords with concatenated VLC/FLC 
structure are used. Codewords are defined for the most common 
168 combinations of last, level, and run. An additional 169th 
codeword serves as an escape coding used for all other cases. 
The 169 codewords, their decoding for last, run and level for 
both intra frames and inter frames are shown in Tables 3a, 3b, 
3c, 3d, 3e, 3f, 3g and 3h. 

This RVLC structure does not lend itself to the type of 
table lookup strategy that is- used for regular VLCs . Normally, 
15 15 bits (without the sign bit) would be read from the 
bitstream. A single table would require 2^^ of 32K entries. 
Alternatively the table could be partitioned according to the 
number of leading zeroes according to the earlier described 
prior art. For the MPEG-4 RVLC leading zero table partition 
doesn't help much. Inspection of Tables 3a, 3b, 3c, 3d, 3e, 
3f, 3g and 3h show there are 24 codewords beginning with 1, 22 
codewords with 2 leading Os, only 2 codewords with 3 or more 
leading Os. All other codewords have exactly one leading 0. 
The lookup table for codewords with exactly one leading 0 
25 would have to cover indices OlOOOxxxxxxxxxx through 
011111101111101 requiring hex3f 7d-hex2000 = hexlfVd (8061) 
entries for the 122 codewords that begin with a single leading 
0. Thus, the leading-zeros VLC decoding approach is very 
inefficient for RVLC decoding. 
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The sparse nature of RVILC codewords makes table lookups 
indexed by the codeword itself inefficient. The structure of 
the codewords can he used to define a pseudo-VLC to access a 
table that can be more densely packed. For codewords beginning 
with 0, a pseudo-VLC is formed with 3 fields as follows. 
First, a number of leading zeros is determined as follows: 

Number of leading Os = 14 - position of third zero 

The pseudo-VLC is a concatenation of these three fields: (1) a 
number of leading zeros as determined above followed by a "1"; 

(2) the position of the second zero; and (3) the first bit of 
the FLO. The number of bits allocated to the second field 

(position of second zero) depends upon the position of the 
third zero. Note that the second zero must occur before the 
third zero. Therefore the number of bits allocated to the 
second field can be decreased if the position of the third 
zero is nearer the beginning of the code. Longer RVLC 
codewords have fewer leading zeros but more bits for the 
position of the second zero. This keeps the maximum codeword 
length for the pseudo-VLC below 16 bits. 

For codewords beginning with 1, a separate pseudo-VLC 
using separate tables are formed by simply stripping off the 
initial 1 bit. Thus: 

Number of leading Os = number of Os in VLC part 



The number of leading zeros in these pseudo-VLC codes is a 
maximum of 11. The pseudo-VLC is then formed by concatenation 
30 of three fields: (1) the number of leading zeros above; (2) 
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"1"; (3) the first bit of the FLC part of the original RVLC 
codeword. The result is the original RVLC with the leading 
"1" omitted. 

The computation of the number of leading Os or leading Is 
5 can be done fairly efficiently as a byproduct of parsing. Many 
devices used for decoding, such as digital signal processors, 
offer a single-cycle instruction to count the number of 
leading Os or Is. This instruction can be used after stripping 
off the starting bit. Tables 3a, 3b, 3c, 3d, 3e, 3f, 3g and 3h 

10 show the RVLC codewords from Table B-23 of the MPEG-4 video 
standard. Tables 3a to 3g show the just described pseudo-VLC 
as the first pseudo-VLC. An asterisk in the pseudo-VLC denotes 
required use ■ of the separate codebook for RVLC codewords 
starting with 1. The "s" at the end of the codewords 

15 corresponds to the original sign bit. 

Decoding the original initial zero RVLC codewords using 
the known leading zeros technique requires a lookup table with 
204 82 words. Following the first transcoding described above 
and shown in Tables 3a, 3b, 3c, 3d, 3e, 3f, 3g and 3h, the 

20 decode lookup table for the pseudo-VLC is reduced to 280 
words . 
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Variations of this first transcoding are possible. The 
second pseudo-VLC shown in Tables 3, 3b, 3c, 3d, 3e, 3f, 3g 
and 3h is formed as follows. For RVLC codewords beginning with 
0, a pseudo codeword starting with 0 can be formed with 3 
5 fields as follows: 



Number of leading Os = 15 - position of third zero 

The second pseudo-VLC is formed by concatenating three fields: 

10 (1) the number of leading zeros determined above followed by a 
1; (2) the position of the second zero; and (2) the first bit 
of the FLC. The number of bits allocated for expression of the 
position of the second zero depends on the position of the 
third zero. For example, if the third zero is the tenth bit, 

15 then the second zero must be in the second bit to the ninth 
bit. Thus 3 bits are allocated for specifying one of these 
eight possible positions of the second zero. If the third zero 
is in the third bit, then the second zero must be the second 
bit. In this case, no bits are allocated to specify the 

20 position of the second zero. In this way, longer RVLC 
codewords have a pseudo-VLCs with fewer leading zeros but more 
bits for the position of the second zero. This keeps the 
maximum codeword length for the pseudo-VLC below 16 bits. This 
maximum was selected because, the hardware VLC decoder of the 

25 preferred embodiment has a maximum codeword capacity of 16 
bits. 

In this second transcoding, RVLC codewords beginning with 
1 are transcoded as follows. A pseudo codeword starting with 1 
is formed with a fixed-length codeword from three fields. The 
30 pseudo-VLC consists of the concatenation of: (1) 1; (2) 4 bits 
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specifying the position of the second 1, or equivalently, the 
number of zeros between the first and second 1; and (3) the 
first bit of the FLC. In this second pseudo-VLC, RVLC 
codewords beginning with 0 are transcoded to pseudo-VLC 
codewords beginning with 0, and RVLC codewords beginning with 
1 are transcoded to pseudo-VLC codewords beginning with 1. 
Because there is no overlap in codewords, a common leading 
zero table may be used to decode the pseudo-VLC, using leading 
zero table lookup. 

Other variations are feasible. The first two transcodings 
described above specified the position of the second zero in a 
zero leading RVLC. The minimum position of the second zero or 
of the second one is the second bit. This minimum position of 
the second zero or the second one might be coded as 2, or 
15 normalized to 0 or any other number. In the third pseudo-VLC 
shown in Tables 3a, 3b, 3c, 3d, 3e, 3f, 3g and 3h, this second 
position is not normalized to 0. This saves computation in 
forming the pseudo-VLC, but results in adding 2 to that field. 
This sometimes rolls over into the leading zeros field, but 
20 still results in a valid mapping. The third pseudo-VLCs can be 
constructed from the second pseudo-VLCs by adding binary 100 
before appending the sign bit. This still results in a one-to- 
one mapping between the original RVLCs and the pseudo-VLCs 
permitting unambiguous decoding. 
25 Figure 3 illustrates electronic system 300 in which the 

technique of this application is valuable. Memory controller 
310 controls data movement between memory 313, on screen 
display (OSD) NTSC/PAL encoder 315, microprocessor 320 and 
image buffer 330. Memory 313 stores the program for both 
microprocessor 320 and digital signal processor 333 as well as 
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serving an input and output buffer and storing intermediate 
data. Memory 313 may include both non-volatile memory and 
volatile memory. On screen display NTSC/PAL encoder 315 is an 
output of electronic system 300. NTSC and PAL are television 
standards. NTSC stands for National Television Standards 
Committee and is used for broadcast television in North 
American and Japan. PAL stands for Phase Alternating Line and 
is used for broadcast television in much of Europe. These two 
television standards are similar. On screen display NTSC/PAL 
encoder 315 produces a television standard using the NTSC or 
the PAL standards for output via cable 317. On screen display 
NTSC/PAL encoder 315 optionally may overlay a text message (on 
screen display) specified by microprocessor 320 on the 
television picture. 
15 Microprocessor 320 serves as the main controller for 

electronic system 300. Microprocessor is bidirectionally 
coupled to communications line 325 via communications 
interface. Electronic system 300 may receive data via this 
connection, transmit data or both. 
20 Image buffer 330 stores at least one frame of image data. 

Both digital signal processor 333 and variable length 
code/variable length decode co-processor 337 have access to 
this image data. Digital signal processor 333 is preferably a 
full programmable data processor capable of operation 
25 independent of microprocessor 320. Digital signal processor 
333 preferably performs image processing on data stored in 
image buffer 330. Digital signal processor 333 is preferably 
suitable for computation of discrete cosign transforms (DOT) 
or inverse discrete cosign transforms (IDCT). Alternately, 
digital signal processor 333 may use another coprocessor (not 
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shown) to compute DCT/IDCT. VLC/VLD co-processor 337 is a 
hardware accelerator operable for both variable length coding 
and variable length decoding. In the context of this 
invention, VLC/VLD co-processor 337 accepts codewords in the 
5 leading zeros format, parses these codes and generates the 
corresponding DCT codes with the aid of corresponding lookup 
tables. In the preferred embodiment, these lookup tables are 
set up by microprocessor 320 or digital signal processor 333 
before VLC/VLD co-processor 337 begins operation. 

10 Electronic system 300 would employ this invention as 

follows. Electronic system 300 receives compressed motion 
picture data via communications line 325 and communications 
interface 323. Microprocessor 320, digital signal processor 
333 and VLC/VLD co-processor -337 cooperate to decompress this 

15 data. Digital signal processor 333 parses and transcodes RVLC 
data into pseudo-VLC data. VLC/VLD co-processor 337 decodes 
this pseudo-VLC data in cooperation with appropriate pre- 
loaded lookup tables. Digital signal processor 333 performs an 
inverse DCT on this decoded data and assembles image data in 

20 image buffer 330 for each frame of the motion picture. Memory 
controller 310 transfers image data from image buffer 330 to 
OSD NTSC/PAL encoder 315 as needed for display generation. OSD 
NTSC/PAL encoder forms a selected NTSC or PAL television 
signal and supplies this signal to a television receiver or 

25 monitor via cable 317. 

Figure 4 illustrates a flow chart of process 400 this 
invention. Process 400 is preferably implemented using digital 
signal processor 333 and VLC/VLD co-processor 337. This 
invention begins by parsing an input data stream to extract 

30 the next RVLC codeword (processing block 401) . Process 400 
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then determines if this extracted RVLC has an initial "1" 
(decision block 402) . If this is not the case, that is, if the 
RVLC codeword has an initial "0" (No at decision block 402), 
then process 400 perforins a first type transcoding (processing 
5 block 403) . As described in the several examples above the 
transcoded data has the leading zeros form suitable for lookup 
table decoding. This transcoded data is decoded using a 
leading zero table lookup (processing block 404) . In this 
decoding, the number of leading zeros in each codeword selects 

10 one of a set of plural lookup tables. The portion of the 
codeword following the leading zeros is used an index into the 
corresponding table. This index selects a memory location 
storing the corresponding decoded data. In the preferred 
embodiment this decoding employs hardware such as VLC/VLD co- 

15 processor 337. Alternatively, this decoding could be done in 
software in digital signal processor 333. 

If the RVLC codeword has an initial "1" (Yes at decision 
block 402), then process 400 performs a second type 
transcoding (processing block 405) . Several examples are 

20 described above. This result in transcoded data having the 
leading zeros form suitable for lookup table decoding 
according to the prior art or another coding type. This 
transcoded data is decoded using an alternate table lookup 
(processing block 406) . 

25 Regardless of the nature of the decoding, process 400 

next outputs the decoded codeword (processing block 407) . In 
the preferred embodiment this decoded codeword is a DCT 
coefficient for a known portion of an image. Together these 
DCT coefficients specify image data. Process 400 then returns 
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to extract the next RVLC codeword (processing block) . Process 
400 repeats for this next RVLC codeword. 

Figure 4 illustrates operating on extracted RVLC 
codewords one at a time. This is merely for convenience of 
5 description. Particularly in case of the second and third 
pseudo-VLC examples, it is possible to transcode multiple RVLC 
codewords into image buffer 330 before performing the lookup 
table decoding using VLC/VLD co-processor 337. 

Figure 5 illustrates an alternative, batch oriented 

10 manner 500 of practicing this invention. Figure 5 is similar 
to Figure 4 except that RVLC codewords are processed in 
batches and the transcoding requires only a single set of 
lookup tables for decoding. 

Process 500 begins by determination if the next bits in 

15 the bitstream are a start code (decision block 501) . This 
start code marks the boundary between one set of codewords and 
another. This boundary could be at a block boundary. If the 
next bits are not a start code (No at decision block 501), 
then process 500 parses the input data stream to extract the 

20 next RVLC codeword (processing block 502) . Process 500 then 
determines if this extracted RVLC has an initial "1" (decision 
block 503) . If this is not the case, that is, if the RVLC 
codeword has an initial "0" (No at decision block 503), then 
process 500 performs a first type transcoding (processing 

25 block 504). As described in the several examples above the 
transcoded data has the leading zeros form suitable for lookup 
table decoding. This transcoded data is stored for later 
decoding (processing block 505) preferably in image buffer 
330. 
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If the RVLC codeword has an initial "1" (Yes at decision 
block 503, then process 500 performs a second type transcoding 
(processing block 506) . In this example, these RVLC codewords 
are transcoded into pseudo-VLC codewords with leading "Is" 
5 such as the second and third transcoding described above • 
Regardless of the nature of the decoding, this transcoded data 
is stored for later decoding (processing block 505) as 
previously described. 

If the next bits are the start code (Yes at decision 

10 block 501), then process 500 recall the next transcoded 
codeword (processing block 507) . If this is the first loop 
after the start code, the next transcoded codeword is the 
first transcoded codeword. The recalled transcoded codeword is 
decoded via a lookup table (processing block 508) , This 

15 process preferably employs VLC/VLC co-processor 337 and an 
appropriate lookup table. Note that the second and third 
transcoding can use a single lookup table because RVLC 
codewords with initial "0" are transcoded to pseudo-VLC 
codewords with initial "0" and RVLC codewords with initial "1" 

20 are transcoded to pseudo-VLC codewords with initial "1". This 
permits these transcoded codewords to be distinguished. 
Process 500 then stores the decoded word (processing block 
509), preferably in image buffer 330. 

Process 500 checks to determine if the last recalled 

25 transcoded codeword was the last transcoded codeword in the 
current batch (decision block 510) . If this was not the last 
transcoded codeword (No at decision block 510), then the next 
transcoded codeword is recalled (processing block 507) . If 
this was the last transcoded codeword in the current batch 

30 (Yes at decision block 510), the process 500 returns to 
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decision block 501 to repeat with the next block of RVLC 
codewords. 
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